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Introduction 


In this paper, we will propose a method for the Identification of the 
pilot's control compensation using time domain techniques. From this In- 
formation we hope to Infer a quadratic cost function, supported by the data, 
that represents a reasonable expression for the pilot's control objective 
in the task being performed, or an Inferred piloting "strategy". (Note 
here that we are using the term strategy as synonomous with control objective, 
and not with control law.) 

The ultimate goals of this research topic Include a better understanding 
of the fundamental piloting techniques In complex tasks, such as landing 
approach; the development of a metric measurable In simulations and flight 
test that correlate with subjective pilot opinion; and to further validate 
pilot models and pilot-vehicle analysis methods. At this time we will present 
liie methodnlony and some nrellmlnarv numerical results. 


The Pilot Model and Objective Function 

The analyses relies on the well-known ^ij optimal -control theoretic 
technique for modeling the human pilot's manual control function. The 
hypothesis upon which It Is based is that the well trained , well motivated 
pilot chooses his control Inputs (e.g. stick force) to meet the pilot's 
(Internal) objective in the task, subject to his human limitations. His 
objective Is further assumed to be expressible In terms of a quadratic 
"cost" function 


Jp = E f (vj QYp . uj . Oj Gi^) 

where Yp * vector of pilot's observed variables (e.g.. 
Up = vector of pilot's control Inputs 
Q,R,G * Pilot-Selected (internal) weightings 


1 


dt 


( 0 ) 


attitude, acceleration) 


The human limitations modeled Include 1nformat1on>acqu1s1t1on and processing 
time delay, observation and control Input errors, and neuromuscular dynamics. 
A block diagram of the resulting model structure Is shown In Figure 1. 

1he components of this model. may be grouped Into two parts, one dealing 
with the Information acquisition and state estimation, and one related to 
the control law or control policy operating on the estimated state. As has 
been shown In the references on this modeling approach, the "solution" for 
the pilot's control Inputs, as predicted by the model. Is expressed as 

. ^ j 

u = q x + q u + v 
p ^x ^U p u 

where x - Internal estimate of the system state 
g , g = control gains 

A U 

Vy = motor noise, or control input errors 

(Readers unfamiliar with the further details of the model are referred to 
the reference.) 

The key points germain to this analysis are that the above equation Is 
a mathematical expression representing the pilot's overt control actions 
(Up), and these control actions are measurable experimentally. Furthermore, 
the gains and g^ are functions of the plant (vehicle) dynamics and his 
objective function, and thereby represent his control "techniques", level 
of skid, and familiarity with the vehicle dynamics. 

Another factor of importance Is that not only is the objective function, 
from which the gains are determined, a mathematical part of a pilot control 
model, but it's resulting magnitude obtained from exercising the model has 
been found to correlate with the subjective pilot opinion obtained from 
simulation and f light test . Such a correlation is shown In Figure 2, as an 
example, taken from Refs. 2 and 3. This of course assumes one has been able 
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Figure 2, Rating Correlation 


to correctly express the pilot's (Internal) cost function, which Is In 
fact his strategy that depends on his perception of the task. Now this Is 
easy to do In simple laboratory tasks In which the subject has been Instructed 
to minimize some displayed error, for example. But It Is not at all clear 
just what flight parameters are being "regulated" or "tracked", other than 
ILS glide slope and localizer error In the case of landing approach. This 
Is but one example, other complex piloting tasks might be considered equally 
as well . 


The Identification Procedure 

We seek then a method by which we may Identify those pilot parameters 
that reflect his control techniques, or control strategy. Referring back 
to the pilot model control law, or 


. j . j 

u^*g„x+gu +v 
p X ’up u 


we note that the gains g^^ operate on the estimated state x. Now the separation 
principle of optimal estimation and control theory states that the control 
gains (g^j, g^) are Independent of the state estimation process. Further, 
the optimal state estimator. In general and In the pilot model, is Independent 
of the overall objective function being minimized by the controller (estimator 
and control) law. Therefore, If we are mainly after the pilot's control 
strategy as expressed by, or at least a function of, his objective function, 
we ne?d only to focus on the gains (g^^, g^) and not on those variables related 
only to the state estimator. These latter variables Include the time delay, 
and observation and motor noise covariance matrices, parameters of interest 
in the identification technique of Levison ^4j , for example. If our approach 
is successful, fewer parameters must be Identified from the data, which Is 
always an advantage, but the parameters affecting the estimation process are 
assumed. 




The Identification method proposed Is as folloMS. The control law 


expressed previously, may be rewritten as 


• T T T 

u BQ x-g e+Q u ‘(’V 
p »x *x p u 


where e ■ error In estimating the true (actual) state x. Note that along 
with the pilot's control u^, these true states, such as angle of attack or 
pitch attitude are measureable , but the state estimate, x. Is a quantity 

A 

Internal In to pilot, as modeled. Hence x Is not measurable — nor are 
c or v^. Transposing the above, multiplying by x • col ^x, u^j, and taking 
expected values yields 
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E(xvJ) 

ECuJ) 
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(I) 


Now to evaluate these matrices we note first that. In a simulation at 

least, the vectors x(t) and Up(t) are measurable, so estimates of their 

covariance matrices (e.g., E(xx^))may be obtained from measurements of 

sampled time histories. (Also, In this paper we assume that good estimates 

of u^ are available from filtered measurements of u^. The details of 
P P 

accomplishing this filtering are under current Investigation, but digital 
techniques as well as analog methods are still available.) For reference, 
refer to Figure 3. 
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with regard to the remaining terms Involving c and v^, both are not 
measurable and need attention. To resolve this consider the complete 
system dynamics model by the relation 

X = Ax + BUp + w 
and 

• T T T 
u * 9 X - g„* + 9 u + V 
p *x ®x p u 

A 

where the relation between state and estimate, or x • x - e has been employed. 

The pilot's Internal state estimation error, c, 1s treated as follows. Define 

c.i “ u ” to be the error In estimation of the pilot's own control Input, 
u p p 

and then let 


c ■ col [c. cj 

Now the covariance of e may be shown to be governed by the relation 


cov (e) = E(e e^) ^ P 
^ « Aj P + PAj + Wj 


Also we have 


Aj z + z Aj + Wj 


ZC^ V'^ CZ = 0; Z = cov (e,^p) 


and 




'9uJ 


C « pilot's observation matrix 

Y » C + V 

P u(t-T) y 


These relations are all obtained from Ref. (5) and from the pilot model 
equations given In Ref. (1). Here ej^p Is che Kalman filter estimation error 
for the delayed state, z the covariance of ej^p, and 


Also W Is tha covariance of the plant disturbance w, and and are 
motor noise and measurement noise covariance, respectively, all assumed 
known. Now the ^ eouatlon may be Integrated over the time delay with 
the initial condition on P from P(0) « i, the Kalman filter error covariance. 

Now, since the predictor has the property that E(x 7^) * 0, we have 

So then the terms E(x e^) and ECu^e^) are available from P, and these are 
required to form M. 

Finally,, It can be shown (Ref. (5)), pg. 331) that with the processes w and 
Vy uncorrelated we have In this case 

E(xv^) = 0 
u' 

Returning then to the estimation of the gains (equation I), we see that 
all the terms In the matrices N^., N^ and M may be calculated, either analytically 
or from the measurements of x, u„ (and u^). The estimate for the gain 

p p » 

vector Is then 



Note finally that the matrix M Is formed from two matrices 
• ”x - »^cor 

where the and N^ matrices may be thought of as corrections added to a 
basic least'squares technique. The potential Importance of these terms (M 

cor 

and N ) will be demonstrated In an example later, 
u 


The algorithm Is as follows: 

1) Select noise covariance matrices, W, V^. and 

2) Select a time delay t, neuromuscular time constant Tj^ (or matrix 

3) Form Aj and solve for Kalman Filter error covariance e. 

4) Solve for covariance matrix P(t) and then the E(~7^) Is available. 
(Note, all these steps may be accomplished before or after the 
experimental data Is obtained.) 

5) Perform experiment to obtain state and control (and control rate) 
time histories. 

6) From the time histories, obtain estimates for E(xx^), E(xUp), 



7) Identify and In E(t e ) found In step 4. 

8) Form M ■ -r and determi ng | 1 from Equation II. 

L^uJest 

9) Check vs Tjlj^ (selected In 2 above) and Iterate (steps 2-8) 
again as necessary. Note now that selecting affects the 
solution for i and P(t), along with the effective or 

'n '^uVN J 

while selecting t only affects P(t) In the procedure. 


Comparison to Classical Results 

It Is Interesting to note that the "corrections" performed by Including 
^cor qualitatively related to an Identification technique 

(discussed In Ref. 6, and elsewhere) used to determine the human describing 


function In a compensatory task, which goes back to the development of the 
"crossover model" of McGruer et a 1 . Shown In Figure 4 Is a schematic of this 
situation, showing the closdd-loop tracking of some commanded Measurements 
may be taken of e^(t), e(t), u^Ct} , and e(t) and manipulated In the frequency 
domain to obtain frequency spectra 

6l(Jui) - Up(ju.)/eg{j«) 

GjCju)) - e(ju)/eg(jw) 

63(^0)) ■ Up(j(i)}/c(ja)) 

Now, In this model the pilot's control Is considered to consist of 

two partr, one correlated with the Input 6^, the other uncorrelated with the 

Input. The latter component was defined to be "remnant." Mathematically, 

Up(jw) • Yp(jhi) c(ju) ♦ r(Jw) and r(j«)/6g(ju) -► 0 In effect. 

Block diagram manipulation leads then to the desired relation 

Yp(ju.) - 6 j(ju))/ 62 (Jo)) 

rather than the simpler, and Incorrect, expression Yp(jw) ■ G3(jw). This 
was due to the presence of remnant r(Jw) In the measured control Input, and 
the necessity to eliminate It's effect by defining It as the uncorrelated 
con^nent of Up, and using this property. Comparing to our control law, 
transformed Just for d.scussibn purposes, we have 

gj c(Ju) ♦ Vy(Ju)) 

unmeasurable 
separately 


unmeasurable 

separately 


Up(ju) ■ gj x(Jw) + gj Up(jw) 


compared to 


Up(jw) ■ Yp(Jw) c(ju>) ♦ r(Ju) 




The significant difference is that r(ju) was, in effect, discarded 
in finding Yp, but gje is not uncorrelated with x or Up and must be accounted 
fo in the identification problem. 

A Numerical Example 

To evaluate the numerical properties and the sensitivity to the a priori 

selected parameters (V^, W, V^, t) a fast time simulation of the pilot model 

equations has been assembled, and the simulated control task is shown in' 

2 

Figure 5 . As shown, the task is that of pursuit tracking with 11.7/s 
controlled element dynamics, and the displayed command signal is filtered 
white noise with the filter transfer function given (0c(s)/w(s)) . The 
state vector is shown, the known gain vector to be identified is listed, and 
the weights in the objective function used are given. A sample time history 
of the state and simulated pilot's control input is depicted in Figure 6. 

Such time histories were sampled at 10 msec intervals and the gains estimated 
from time windows of data 5, 10, 15, 20, 25, 30 and 35 seconds wide. The 
root-sum-squred percent error of the five estimated gains is shown in Figure 7. 


Where 

^RSS * 






As shown, about 30 seconds of data is required to obtain less than 10% rss 
error in this example . Other dynamics of higher order, and therefore more 
gains, will be evaluated in the near future and the convergence will not 
be as rapid. 

The importance of using the proper corrections (e.g., M and ) 

uor y 

is shown in Figure 8 , in which the five exact gains, g^ -► gg are shown, 
along with two sets of gain estimates. The set labeled "uncorrected" was 
obtained via straight-forward least squares (i.e., and not included). 
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-,—L£Z 

+ 3s + 2.25 



= [0c 0c ® ®] 
X = AX + BU + N 


Up - gJ Xp + Gu Up + Vu 

[gJ G|j]= [ 5 . 53 , 1.86, -6.76, -3.69, -9.2Sl 
Oj- = 16/. 35, Q- = 1/.35, ©5 = 1 


Figure 5 
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Figure 8 




Conversely, the "corrected" set used perfectly corrected data, or the actual 

A 

X's In the Identification. Both sets of gain estimates are based of 50 
seconds of data. Clearly, In this case again, the corrections are 
Important. Further verification of the method Is In process. 


Inference of the Objective Function 

Attention Is now turned to estimation of the objective function weightings 
from the gain estimates just discussed. (Note, this Is referred to In the 
control literature as the "Inverse problem".) These weights are 
related to the gains via the Riccatl matrix K, the solution of 


A^K + KA + Q - KBG"^B^K » 0 


and 


where 


’I j aj] ' 


* A * B 
As 

0 1 0 




c\c; 0 

...d. J.... 


I = Identity of dimension equal to u control 
“ vector P 


And recall that Q^, R, and G are the weightings defined In Eqn (0). Now 
due to the structure of the OCM, we are ^ble to reduce the above Into some 
simpler relations. First, noting that lett?ng G » 1^, without loss of generality 
(at least In the case of scalar control Input Up), we obtain 


and 



go + q^B + B^Q 
^u^u ^x ^x 


(III. a) 



(Ill.b) 

(III.c) 


0 - 9,9„ - LB + 

C\C - 9*9! - LA - A^L 

Now L can be eliminated In the last two relations tf desired, and have 

- B^g^gjB - H - (IV) 

where 

H - (9„9j ♦ 9l*)« 

By observing Equation III (and IV) we can see that If estimates of g^ 
and g^ are available, and plant and observation matrices A, B, and C are 
known, the R weighting can be obtained directly, but requires special 
attention. From Egns. Ill.b and .c we see that if L can be obtained by 
solving Ill.b, an n x n matrix equation with only C^QC unknown results from 
III.c. But this Is only possible If B”^ exists, which is only true If the 
number of Independent control Inputs (In u^) equals the number of states 
(in x)>an unlikely situation. 

An alternate attack using Eqn. IV leads to similar results. One could 
conceivably solve for a diagonal Q via a numerical method like Newton- 
Raphson, but that requires the matrix CBB^C^ to be invertable. This Is possible 
if the number of control inputs (in Up) equals the number of outputs (or y), 

(or the system transfer function matrix is square). Although this is less 
restrictive than the previous situation, it is also untrue in many applications 
of interest to us here. So the following conclusions may be stated, that In 
general a unique set of objective function weights may not be obtainable from 
gain estimates alone. This result is not new, we've Just looked at It In 
the context of our specific problem. 



Although Improved methods are currently under Investigation In this 
regard, we may always test assumed objective function weights to determine 


If they're feasible. This Is considered a reasonable alternative since In 
an actual experiment, the analyst knows several reasonable statements for 
the objective function, and he may at least test them to see which one Is 
best supported by the data. To pursue this approach, the accuracy of the 
gain estimate will also be developed such that statistical hypothesis tests 
may be performed. But for now, this Is an Important consideration. 

In the case of our numerical example. Equation III. a leads to R * 0, 
and Equation IV yields 

(11.7)2(q. ^ ^ .2(11.7)g^g^^ + (11.7 g^^^)2 

where 

q 0 0 0 ' 

e 

0 q^ 0 0 

0 0 qg 0 

0 0 0 q‘ 

Using the estimated gains we obtain 

(q* + q*) » 2.89 (actually q^ was 1/.35 and qg was 0) 

Now "guessing" that q. and q* were zero, at first, we may Iterate on q 
and solve III.c, then check with Ill.b. If no q^ > 0 led to a solution, 
then the assumption of q„ and q* equal to zero would need revision. Finally, 
note that from Equation Ill.b, we can actually solve for as many columns (and 
rows) of L as the number of control Inputs (or rank B), and this part of 
the L matrix may he used to check results from III.c. 
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